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ABSTRACT 

Development of digital resources is difficult due to their particular complexity relying on pedagogical aspects. 
Another aspect is the lack of well-defined development processes, experiences documented, and standard 
methodologies to guide and organize game development. Added to this, there is no documented technique to 
ensure correct implementation of a competency in a videogame. This research proposes a Short Serious Game 
Development Process founded in Software Engineering paradigms and complemented by previous efforts on 
large scale development of digital learning resources. This paper focuses in a technique called Competency- 
Based Decomposition that achieves implementing a formal competency into a short serious game, with which 
the formal learning process will be complemented to improve the way students learn. Through a case study will 
be demonstrated its utility by implementing the process and the technique in the whole of mathematics 
competencies for sixth grade of elementary school in Mexico. The result of applying the proposed process for 
study case is a collection of video games that satisfactorily implements the competencies and its contents, its 
expected learning and its knowledge areas specified for sixth grade of elementary school in Mexico by the 
Ministry of Public Education. 

INTRODUCTION 

Through the experience gained by the different entities of software developers has identified the need to manage 
a software project for it to be successful. 

To manage a project, four desirable characteristics of a software development team are identified (Reyes 
Delgado, 2005): the creation of a set of defined processes, the quality of products and, efficacy and efficiency 
efforts. To achieve the proper management of a software project should be performed, in the first instance, the 
creation of the defined processes of the organization through the use of best practices and formal software 
engineering methods and matured to match to the actual process of the organization. 

Defined software development processes receive much attention in research, but are rarely used in industry for 
the development of software systems. One of the main reasons is that very little is known about the integration, 
interpretation, definition and adoption of software process and the precise role of processes in the lifecycle of 
software remains very diffuse (Plat & J. Toetenel, 1992). 

Despite all the stresses generated in research centers, as mentioned in (Plat & J. Toetenel, 1992), globally there is 
a significant percentage of software development companies that do not use software processes for the 
development of projects. This problem can also be attributed to the fact that many entrepreneurs and software 
developers ignore the potential benefits of using software processes and their definitions for both quality of 
product and the quality of the process, and therefore the project (Chatzoglou, 1997). 

When thinking about a large scale resource production you should think in a production that involves the 
creation of a set of software products through a development process based on standards, methodologies, process 
guidance and best practices of software engineering (Oktaba & Ibargiiengoitia Gonzalez, 1998). At this point, 
the Software Engineering provides a mechanism for the development of affordable software systems, and 
through organizations such as the SEI (Software Engineering Institute) and ISO (International Standardization 
Organization), have generated international standards for assurance of quality in software development processes 
and the management of resources and models to measure the maturity of software development processes, such 
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as CMMI (Capability maturity Model Integration), Rational Unified Process (RUP), Software process 
Improvement and Capability Determination (SPICE), Process Model for Software Industry (MoProSoft, 
internationally known as ISO 29100), Personal Software Process (PSP) and Team Software Process (TSP). 
(Sommerville, 2005) (Pressman, 2006) (Kulpa & Johnson, 2003) 

But when talking about digital educational resources, “ A large scale development of digital learning resources 
involves the creation of a large number of these educational resources with a time limit, usually with the aim of 
supporting one or more educational courses .” (Velazquez Amador et ah, 2011) 

PROBLEMS OF THE LARGE SCALE DEVELOPMENT 

As mentioned in (Barajas Saavedra, Munoz Arteaga, Alvarez Rodriguez, & Garcia Gaona, 2009) and (Velazquez 
Amador, et ah, 2011), a large scale development of digital learning resources involves the creation of a large 
number of these educational resources with a time limit, usually with the aim of supporting one or more 
educational courses. 

Some of the reasons why it is not often the large scale development of digital resources are (Barajas Saavedra, 
Munoz Arteaga, Alvarez Rodriguez, & Garcia Gaona, 2009), (Velazquez Amador, et ah, 2011), (Vidani & 
Chittaro, 2009), (Masuch & Rueger, 2005): 

1. The difficulty of developing these resources, as they are resources with particular complexity by relying 

on pedagogical aspects. 

2. Lack of well-defined development processes and experiences documented. 

3. Lack of standard methodologies to guide and organize game development. 

4. Game development in an educational environment have to face some severe restrictions in the 

development process compared to professional game development. This implies manpower, 
development time, and budget. 

5. Lack of mechanism to guarantee the correct implementation of pedagogical aspects into the games, like 

for example a “Serious Game Requirements Management” or “Serious Game Quality Assurance”. 

However, despite the existing difficulties, in video games lies a viable means to solve the current problems of 
education, creating materials that support the knowledge acquired in the classroom, extending the classroom 
beyond the physical limits of the educational institution and allowing students to have an improvement in the 
way of learning through the use of these resources. 

This research is providing solution to the lack of well-defined development processes for large scale production 
of serious video games, presenting a proposal for a development process with fundamentals in software 
engineering practices (Barajas Saavedra, Alvarez Rodriguez, Munoz Arteaga, Santaolaya Delgado, & Collazos 
Ordonez, 2014), the results of using this process for the production of various video games (Alvarez Rodriguez, 
Barajas Saavedra, & Munoz Arteaga, 2014), and the results of usability testing of video games with students 
(Barajas Saavedra, Alvarez Rodriguez, Munoz Arteaga, Santaolaya Delgado, & Collazos Ordonez, 2014). 
Solving, in this way, the problems identified within this subject of investigation (Barajas Saavedra, 2009), that is 
to say: (1) the experts in contents have not been provided with simple and intuitive tools that automate the large 
scale production; (2) the game producers do not have the rationale that supports the structuring or design of the 
serious game, or the experience in the competencies in which the videogame applies; (3) for the production of a 
serious game neither a structured nor based on software engineering process exists that guarantees the 
consistency and standardization of the production to increase and to guarantee the quality of products. 

This paper will present in detail the mechanism to guarantee that the pedagogical aspects (competencies, 
knowledge areas, contents and expected learning) are correctly implemented into the short serious games 
through a technique called Competency-Based Decomposition. 

SHORT SERIOUS GAMES (SSG) DEVELOPMENT PROCESS 

A Short Serious Game is a serious game that must have the following elements, regardless of their purpose 
(training, education, etc.) and its competencies: 

1) Pedagogic aspects, which include the next elements: 

a) Learning needs of the individual or group of individuals. 

b) The social and cultural context of the individual or group of individuals. 

c) Learning methodology (includes consideration of the learning model and learning styles). This aspect 

covers the elements "Pedagogic considerations", "Learner specification" and "Context" proposed by 
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deFreitas and Oliver in (de Freitas & Jarvis, 2006) and (de Freitas & Oliver, 2006). 

2) Technical aspects including: 

a) Considerations for game-play and story (Zyda, 2005). 

b) Level of fidelity, interactivity, immersion, fun, etc. 

3) Integration aspects that include: 

a) Considerations for game-based learning (Martens, Diener, & Steffen, 2008). 

b) Considerations for inclusion of materials in formal classes. 

c) Considerations of context for the implementation of digital educational resources (de Freitas & Jarvis, 

2006). 


In Figure 1 can be seen the SSG Development Process proposed by this research, which has the next features: 

1. is founded in the traditional Software Engineering paradigms; 

2. provides developers and game designers with a process that will lead them clearly through the production 

of an educational video game; 

3. provides a framework for the integration of experts from different disciplines to develop an short serious 

game; 

4. allows to implement the process in a transparent way because the game is considered as a software 

product; 

5. provides, at the stage of requirements, the ability to develop products that tell teachers how to integrate 

the game with their classes. 


Besides, this process enables SSG Developers to correctly manage SSG Requirements with Software 
Engineering best practices. Also, this process provides a new technique called Competency-Based 
Decomposition that transforms a competency and its components (contents, expected learnings, and knowledge 
areas) into a manageable and measureable software requirement so developers can successfully implement or 
develop at large scale those requirements (competencies) in the SSG. 


Requirements 
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Figure 1. Short Serious Game Development Process. 

Then, the fulfilment of the requirements must be ensured in order to guarantee product quality. The compliance 
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with requirements must be seen from the views: pedagogical, educational and ludic. 

Next section presents a review of the quality aspects for digital educational resources and serious games, and 
presents a set of characteristics a short serious game must meet in order to have a good grade of quality. 

QUALITY OF THE SHORT SERIOUS GAMES 

In the particular case of educational resources studied in this research, (Velazquez Amador, et al., 2011) 
mentions that the quality of a digital educational resource covers various aspects of software development using 
an object-oriented paradigm, and issues related to pedagogy. Therefore, is identified the existence of technical 
and pedagogical aspects, and usability and content components, which are considered as aspects that determine 
the quality. 

1. Technical aspects include reuse and adaptability, as well as those established by the software engineering 

as utility, reliability, among others. 

2. Pedagogical aspects contemplate everything that facilitates the teaching-learning process, as we have 

examples, assessments, self-assessments, feedback, and a pedagogical objective expressed under any 
taxonomy, to mention some, Bloom's Taxonomy. The relationship between teaching methods and 
quality of the resource depends on the learning style of the user, so that John recommends that the 
modalities of digital resources include auditory, visual and kinesthetic recommendation that 
videogames cover perfectly. 

3. In the content items are those that give information about the complexity of the subject and the level of 

detail that addresses the content. 

4. The aspects of usability of a digital resource concern the presentation of information (fonts, colors, sizes, 

etc.) and the disposition thereof (symmetrically, asymmetrically, using positive and negative space, 
etc.). From the point of view of software engineering usability it means ease of use and learning of an 
object created by humans. 

Bearing in mind the quality aspects for serious games, and the analyzed literature on video games and learning 
objects, a non-exhaustive set of basic features that represent a good starting point to achieve a usable product 
with a good grade of quality were identified: 

1. Short and focused on a single knowledge area to guarantee portability of the video game. In case of a 

Game Scenario can implement all the knowledge areas of a competency through a set of mini-games or 
in a single game. 

2. Graphical user interface with aesthetic and minimalist design, friendly, and pedagogically evaluated; 

3. Cases with formal reasoning; 

4. Cases randomly generated to prevent the student memorize the answers to problems; 

5. Challenging content and generating competition among students using the game, i.e., cases with different 

levels of difficulty. 

COMPETENCY-BASED DECOMPOSITION: A REQUIREMENTS IDENTIFICATION TECHNIQUE 

This “Short Serious Game Requirements Management” was not found in the literature review done, so this paper 
will present a mechanism to match a formal competency with a non-formal content, identifying the aspects 
(contents and expected learnings) and factors that should be implemented in the production of the game so that 
satisfactorily cover the expectation of the competency within a scholar grade and guarantee the quality of the 
serious game through the fulfilment of the requirements. This process is called Competency-based 
decomposition (CBD), which is a proven successful way to accomplish the production of a digital educational 
resources that was applied for the development of the project “Business-Academia-Govemment Linkage Model 
for the Development of IT Capabilities of Human Resources” (Known in Spanish as “Modelo de Vinculacion 
Empresa-Academia-Gobierno para el Desarrollo en Capacidades de Capital Humano en Tecnologias de la 
Informacion”) (Velazquez Amador, et al., 2011). 

Before continuing, the definition (based upon the review of the work in (Mulder, Weigel, & Collins, 2007) and 
(Diaz Barriga, 2006)) used in this research for competency is as follows: “Competencies are all mental resources 
of individuals that are used to master tasks, acquire knowledge and achieve a good performance in some 
specified abilities with a certain skill level.” 

With this procedure it is proposed to completely cover the contents and learnings that accompany a subject in a 
syllabus, thus ensuring the appropriation of knowledge and learning outcomes for a particular competency. 
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To perform the CBD is necessary to complete the following steps for each subject to analyze. 

1. To identify the standards, goals and graduate profiles (SGGP) of the subject analyzed. This step is very 

important as the products of the subsequent steps must be aligned to these elements. 

2. To identify the contents and expected learning of the syllabus. 

3. To group, in knowledge areas, the contents and expected learnings in accordance with SGGP. 

4. To organize knowledge areas in accordance with SGGP. 

5. To identify competencies from the knowledge areas grouping. 

6. To organize competencies and their knowledge areas in accordance with SGGP. 

it is very important to stress that every competency and its knowledge areas must be attainable from the point of 
view of the Software Engineering, since, for example, the Study Program for Sixth Grade Mathematics 
published by the Ministry of Education, provides a set of math competencies, namely: 

1. Solve problems independently. 

2. Communicate mathematical information. 

3. Validate procedures and results. 

4. Efficiently handling techniques. 

Where all of them are “Competencies for life”, which, from the point of view of the Software Engineering, are 
very complex to manage and measure due to their multifactor nature. 

In the next paragraphs is shown the application of this CBD process which was applied in this research to 
identify all the competencies for sixth grade mathematics to carry out the production of video games. 

USING CBD TO IDENTIFY SOFTWARE REQUIREMENTS 

This section will show the process to apply the CBD step by step using the Sixth grade math of Elementary 
school in Mexico. 

Step 1. To identify the standards, goals and graduate profiles. 

In the next figures is shown the standards (Figure 2), goals (Figure 3) and graduate profiles (Figure 4) from the 
syllabus analyzed. 


Syllabus 2011 f Teacher'; Guide 
Elementary school / Sixth grade 


Mathematics Standards 


T he Mathematics Cumcufcw Standards present a vmon of a population who know 
how to use mathematical knowledge Compose the set oMeammo expected od 
students tn lour school periods to lead to hKjh levels erf mathematical Motacv 

Consist of 

1 Number sense and algebra* tharfong 
2 Shape space and meesive 
3 Information management 
4 Attitude towards the study of mathemoiks. 

T heir progress should be understood as 

• Moving from everyday language to maihcmaticjl language to explan procedures 
and results 

• Broaden and deepen the knowledge so mat understanding and eftcient use of 
mathemabcai tools are favored 

• Mowtg from me reguest lor help n soMng problems towards self-employment 

Figure 2. Standards of the study of mathematics for elementary education established in the Syllabus 2011 
published by the Mexican Ministry of Education. (Secretarla de Educacion Publica, 2011) 
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Syllabus 2011 l Twchfr'i Guide 
Elementary school / Sixth grade 

Purpose of the study of mathematics for 
elementary education 

Al tto stao* of ihe* education as a rasu* of r» study of mathamabes it ts expected 
thtf stodanto 


Know and use 9w proposes of me decanal sy s t m 



• Use 



Use and weerpret venous codes tor oneniaaon wi space and locale otiecisor places 
Express and nS c rprrl measures we dAercre types of und to c Ac id tor p c n rm l er s 
and areas of tnangirs quadnltoerato regular and rregular polygons 
Engage m search processes organuafton analyse and ntorpretafton of data e 
images teal tables bar graphs and cther earners to prowtoe ntormason or a w nar 
quntom for N wuh n or Otar s Represera data mng tables and bar charts 
Idanaty sets of gaa n a tui that vary proporbonaisty or vregoerty cakuiatng nmnj 
values and percentages and apply the praporaontoty constant factor (Mti natural 
numbers) *» svnple cases 


Figure 3. Purposes or goals of the study of mathematics for elementary education established in the Syllabus 
2011 published by the Mexican Ministry of Education. (Secretaria de Educacion Publica, 2011) 



Third school term, the end of the sixth grade, 
between 11 and 12 years old 


tn ths ponod CumcUfcr Standards correspond to three themaftc axis Number sense 
and algebrac thmtong Shape space and measure end Information handtaig 

After the thad period students know hoe to commune ale end mtarpret natural 
numbers fracbonef or decimal numbers es wrt as soft* probteans using adiMrve and 
mubpbeafeve convantanaJ algorithms Catculafo penmafors and aieas and can desenbe 
and txakj and total figures They use reference sys t e m s to locale poeits m the plane or 
to mterprel maps Also perform processes of cofttcUng organong ana#y/mg and 


Based on the leechng methodology proposed tor study in this course, students ere 
expected to also acquire mathematical knowledge and stofts develop ata tud as and 
values that era essonbal n tho construe ton of mathematical co m pel once 


1. Numeric seme and algebraic thinking 
During tho period the axis nc Hides the next topics 

1 1 Numbers and number systems 
1 2 Addtrve problems 
13 Mutaptaabve problems 

The Cumcular Standards lor thn am are the next ones The student 
111 Readng *ntrg and companng natural Sac Sons and decmal numbers 
121 SoMng addbve problems eahtracsonal or decimal numbers uengconvereonal 

1 3 1 SoHng peettams that mpte s muApty or dmdn g natural numbers using 
conventional atponhns 

132 Sonmg proCMemt tnat repaes mutptyng or esidng Sacooneor deema numoers 
using lorr v ensonar a lgorerm s 


Figure 4. Graduate profile of mathematics for elementary education established in the Syllabus 2011 published 
by the Mexican Ministry of Education. (Secretaria de Educacion Publica, 2011). 
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Step 2. To identify the contents and expected learning of the syllabus. 

In the Syllabus 2011 can be found all the subjects that integrate a scholar grade, and each grade is divided into 
blocks. 


Each block is integrated in its first level by the central axis, in its second level by the topics, and in its third level 
by the contents. This can be seen in Figure 5. As you can see there are only three axes in the figure, this is due to 
that the fourth axis “Attitude towards the study of mathematics” is implicitly evaluated by the other three axes. 


Block I 


COMKTtXiU TO (MM4MCC: $o».e problem* ndtptndendy • Commute** mathematical rrformafton • Vofcdot* procodurn and 
retufc* • Efftcitfltfy tvandtoa technique* 

Emcne ixtfMNO 

CnTULMJ 

NuuiCtUMU 

ALCCBOAIC TmeONG 

Tom. vtct ut> mlasunz 

||0C*MT>OM KMUCtMOft 

* Sohre problem* atvofong read 
*r*« and compare natural 

froc tonal and dec mol number*. 

specifying the companion 

ertfena 

• SoKe add** problem* wdh 
natural decanal and fracbonai 
number* arvofong teo or more 
transformation* 

*Readng wrtfmg and comparing 
natural fraction* and decanal 
number* Explanatory d 
companion cneena 

• uxmtyog tht f ymnufry am & 
a frgum (po», 9 orjl o« not 
pctygonll) *nd mjSuj#, 
tymratncil itvapM throng* 
different rttourm 

* Calculation of percentage 
amount* by vanous method* 
lappkotcn of correspondence 
‘per 100 n* <n piemenv*g a 
common or decanat fraction 
usmg 10% a* base) 

• Sofang oddfcve problems wdh 
natural decanal and fractional 
rxanber* varying the Uructure 
of problem* Study or 
reohvmoton d conventional 
algorithms 

* Chooung a coda to 
(«muKa» lh* location of 
ctgKtfr m J gnd Embfrrtngef 
common codat fcc locating 
obfacts 

■ Cakiimmg rtji dstancat 
(hough rough immuwi 
from ona port lo anothaa or a 
map 


* Detcnbe* route* and calculate* 
the real rtatonce from one pont 
to another on maps 

* RaaSmg data m uMi and erdt 
grapM to antaai OnarM 
guotooang 


* Sotnng mdbpheatrre problems 
wtfi fractional or decanal values 
through odormol procedure* 



Figure 5. Extract of the syllabus for sixth grade math of elementary school. This figure shows the competencies 
to enhance, the expected learning, the central axes, the topics and the contents for the Block I. The syllabus is 
integrated by five blocks. Note that the fourth axis is not shown due to is evaluated implicitly in the other three. 

(Secretaria de Educacion Publica, 2011) 


Step 3. To group, in knowledge areas, the contents and expected learnings. 

After identifying the contents and expected learning, the grouping resulted in the next knowledge areas: 


1. Areas 

8. Handling of 

solid 

15. 

Shapes and 

2. Cartesian plane 


figures 


polygons 

3. Combinations 

9. Lengths 


16. 

Time 

4. Cross product 

10. 

Odds 


17. 

Values of unity 

5. Decimal system 

11. 

Operations 

18. 

Volume 

6. Fractions 

12. 

Patterns 


19. 

Weight/Mass 

7. Graphic representation 

13. 

Percentages 



of results 

14. 

Perimeters 




Step 4. To organize knowledge areas. 






The process of organizing the knowledge areas resulted in 

the creation 

of “groups” 

that later will be 

competencies. 






1. Competency 1 



3. Competency 3 


a. Operations 



a. 

Lengths 


b. Decimal system 



b. 

Volume 


c. Fractions 



c. 

Weight/Mass 

2. Competency 2 



d. 

Perimeters 


a. Shapes and polygons 



e. 

Areas 


b. Handling of solid figures 


f. 

Time 


c. Cartesian plane 



4. Competency 4 
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c. Cross product 

d. Percentages 
6. Competency 9 

a. Combinations 

b. Odds 

Step 5. To identify competencies from the knowledge areas. 

The identified competencies are: 

1. The numbers, relationships and operations 

2. Geometry 

3. Measures and Conversions 

4. Information processing 

5. Processes of change 

6. The prediction and chance 


a. Graphic representation of 

results 

5. Competency 5 

a. Patterns 

b. Values of unity 


Step 6. To organize competencies and their knowledge areas. 

The Competency-Based Decomposition process is graphically shown in the following figure (see Figure 6). The 
final result of this process, is shown in Figure 7. 


Scholar Grade 


Subject A 

Subject B 

_ . , _ . Graduate 

Standards Goals „ ... 

Profile 

Standards 

_ . Graduate 

Goals _ ... 

Profile 

Contents and Expected Learning 

Contents and Expected Learning 

KA 1 KA 2 

KA 3 

KA 4 

KA 1 KA 2 

KA 3 KA 4 KA 5 

Competency 1 

C 2 

C 3 

Competency 1 

Competency 2 

Game 1 Game 2 

Game 3 

Game 4 

Game 1 

G 2 G 3 G 4 


Figure 6. This approach allows to match a formal competency with a non-formal content, identifying the aspects 
and factors that should be implemented in the production of the game so that satisfactorily cover the expectation 

of the competency within a scholar grade. 
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Sixth Grade - Elementary School 

Mathematics 

Standards Goals Graduate Profile 


Contents and Expected Learning 
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relationships 
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Geometry 
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Information 

processing 
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change 
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r \ 
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f. ' 
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Figure 7. Result of the Competency-Based Decomposition applied to the subject Mathematics of sixth grade of 

elementary school. 


CASE STUDY: SIXTH GRADE VIDEO GAMES 

As a proof of concept of our approach the research conducted a case study using as scenario “the development of 
educational games to cover all the official competencies for sixth grade for elementary school in Mexico”. 
Competencies shown in Figure 7 lead us to create a collection of fifty educational videogames oriented to 
increase learning encouraging appropriation of specific math-competencies. A summary of this list is presented 

in Table 1. 


Table 1. Extract of developed video games. 


Video games 

Knowledge areas 

Language 

pokeMath 

Operations 

JavaME 

MathChallenge 

Operations 

.NET 

Weight/mass 

.NET 

DS3A 

Operations 

JavaME 

SpaceMath 

Operations 

Flash 

Fracciones 

Fractions 

JavaME 

GeoBodies 

Shapes and polygons 

JavaME 

CubeLand 

Handling of solid figures 

OpenGL 

Submarino 

Cartesian plane 

JavaME 

GolfMeter 

Lengths 

JavaME 

miHuerta 

Volume 

JavaME 

Areas 

Areas 

JavaME 

Ubicacion 

Values of unity 

JavaME 

Regia de Tres 

Cross product 

JavaME 

Kaxan 

Percentages 

JavaME 

WWE 

Odds 

JavaME 

Marcianos 

Shapes and polygons 

Android 

Time Rider 

Time 

JavaME/Android 

Time Champ 

Time 

JavaME/Android 

Jinete Solitario 

Lengths 

JavaME/Android 
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Perimeters 

Perimeters 

JavaME/Android 

Softy 

Combinations 

JavaME/Android 

MathFractions 

Fractions 

JavaME/Android 


TESTING THE VIDEO GAMES 

After the initial production phase of educational video games, the team proceeded to test them in order to study 
the impact on the learning level of students exposed to this learning strategy. Participants consisted in a group of 
29 students from sixth grade of elementary school from the “Federal Rural Cuauhtemoc Elementary School” 
located in La Paz, Ojuelos, Jalisco. Children studying in this school come from families just as scarce resources. 
This community has many needs, and to increase the use of IT access to information technology helps to 
alleviate some of them. 

The process performed for the test was as follows(Hernandez Sampieri, Fernandez Collado, & Baptista Lucio, 
2010): (1) Identify potential schools. (2) Tests were designed for initial and control evaluations. The tests were 
designed to evaluate knowledge level of students in the next knowledge areas: Areas, Handling of solid figures, 
Fractions, Shapes and polygons, and Crossed product. (3) School was selected. (4) Students group was selected. 
The group was divided into two parts; taking into account that in both groups, students’ average grade must be 
equally distributed, i.e., the group was divided according to the average grades of the students. (5) Initial 
evaluation was applied to all students. (6) The test group used video games in one-hour sessions twice a week for 
four weeks. (7) At the end of eight sessions, a control test was applied to identify the impact of video games use. 
(8) The collected data were analyzed with SPSS software. 

RESULTS OF KNOWLEDGE EVALUATION 

The team applied linear regression to the results obtained during testing for each knowledge area. The 
information allow to determine trends in student’s scores before and after use short serious games. The overall 
findings are graphically depicted in Figure 8 where diamonds-line displays the results obtained during initial 
examination. Squares-line displays the results of the evaluation performed after short serious games use. 


Average grades of kids that used games - 
First vs. Second Exam 



Figure 8. Overall result of the students in different areas of knowledge tested. 

As the reader can see, there are improvements in four knowledge areas, this is due to the students achieved a 
higher level of adoption of the competencies implemented in the short serious games they used. 


The “Crossed Product” game, which shows a decrease in the adoption of the competency, was developed with a 
question bank instead of randomly-generated problems, so the students memorized suck question bank and did 
not achieve the intended adoption of the competency. 


DISCUSSION 

The correct implementation of the competencies and the characteristics of the short serious games is extremely 
important because this is the only way to guarantee that the students of users will achieve a higher level of 
adoption of the competencies implemented in the games. 
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As the reader can see, the “Crossed Product” game did not achieve its purpose: transfer the competency into the 
students due to a deviation in its development. 

CONCLUSIONS AND FUTURES WORK 

This research proposes a short serious game development process that includes an explicit requirements 
management which allows the identification and modeling of the software requiremets from a set of implicit 
educative competencies of an official syllabus. 

This process makes available to research or (independent) development groups, universities and companies a 
clear guide to the development of a short serious game. It also eases the implementation of the process itself 
because it has a documental support that guides the team through the development of the products. This process 
also allows managing the product quality through checkpoints in the provided documentation, achieving in this 
way develop a high quality product with a high level of fulfilment of the competencies (requirements). 

The CBD process allows clearly identify the competencies to implement in the short serious games, since in 
many cases this aspect is not taken into account during the development process (if a development process 
exists). The CBD process takes as inputs common elements in the syllabus and turns them into short serious 
game programmable and measurable competencies (requirements). 

Once identified the competencies, the short serious game development process is capable of building software 
products, from those requirements (which include learning activities and learning contents), with a high quality 
level and meeting the correct implementation of the competencies. 

This research has created and tested (with real world students) a big set of short serious games, achieving an 
improvement in the competency adoption due to the correct implementation of requirements (competencies, 
learning activities and learning contents) into the games. 

The short serious game process is being translated into SPEM and ISPW-6 with a variability model and will be 
published online once it is finished. In this way it will be turned into a Serious Game Development Framework 
that will be accessible to anyone interested in developing short serious games. 
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